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(57) Abstract 



Apparatus (10, 20) decodes input video data which is encoded in different data formats and is received on a common physical 
communication link. The decoder includes a first processor (50) for decoding image representative data which is packetized in an Internet 
protocol compatible data format and is received on the common communication link. The decoder also includes a second processor (75) 
for concurrently decoding broadcast video data which is packetized in an MPEG compatible data format exclusive of the Internet protocol 
data format and is received on the common communication link. The first and second processors produce first and second decoded video 
outputs respectively. Also, the proportion of the image representative data conveyed on the common communication link relative to the 
broadcast video data may be dynamically varied. The decoder also includes a display processor (55, 80) for forming a display image from 
the first and second decoded video outputs. 
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5 

Multimedia Decoder and Bi-directional Broadcast 
Communication System 

Field of the Invention 

10 

This invention concerns interactive bi-directional 
communication in a broadcast system, and more particularly to 
the decoding of multiple data services and their presentation to a 
User. 

15 

Background of the Invention 

Home entertainment set-top box systems which 
combine Personal Computer and television functions (PC/TV 
20 functions) are increasingly becoming generic, User interactive, 
multiple source and multiple destination communication devices. 
Such systems are required to communicate in different data 
formats between multiple locations for a variety of applications in 
response to User requests. For example, a set-top box system may 
25 receive data from satellite or terrestrial sources comprising High 
Definition Television (HDTV) broadcasts, Multi-point Microwave 
Distribution System (MMDS) broadcasts and Digital Video 
Broadcasts (DVB£ m /C set- top' box system "may also receive and 
transmit data via telephone (e.g. the Internet) and coaxial lines 
30 (e.g. cable TV) and from both remote and local sources such as 
Digital Video Disk (DVD)*- CDROM, VHS and Digital VHS (DVHS™) 
type players, PCs, and many other types of sources. 

It is desirable for a set- top box sy stent; to be able to 
support bi-directional communication and in-home control 
35 functions and to be able to access and decode information from 
multiple broadcast sources.; It is also desirable for a: set-top box 
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5 system to be able to seamlessly combine the decoded information 
for presentation ' to a User. There are a number of problems in 
achieving such a system. Specifically, problems arise in efficiently 
acquiring information of different data formats , from different 
sources and prioritizing, , the . processing of the information. , These 
10 problems are addressed , by a system according, to i the present 
invention. 



Summary of the Invention 



A decoder., .system advantageously ■■> incorporates 
separate tuner, demodulator and processing paths for concurrent 
and scaleable (dynamically ^variable, *it-rate) , processing and 
decoding of broadcast. Image representative data , encoded in 
different data formats and received on a common physical 
20 communication link. The decoder system also advantageously 
incorporates a separate return, channel communication path 
permitting secure return communication with a broadcast source 
on the common communication link.*- , - . . . 



; , - - . Description .of the Drawings: . %<■■. ■ •<: 

In the drawing; Jy r , . ^r : .v .- f »oof-r ;.,v. r 

Figure _l f shows .a, ^scaleable, decoder system for 
efficiently communica^ng jiyith a. plurality,. M of sources: andi for- 
30 processing, exemplary.' "^P/IP , and^, .MPEG, format data, according to 
the invention. 



Figures 2 ; t and 3 ,., present,. . exemplary - characteristics of 
the broadcast, data and. return, channels depicted i ixr the system of 
35 Figure 1, according, to the invention. 



Figures 4 and 5 list the data : . traffic type and an 

exemplary bit rate allocation for services - provided via the 

upstream channel and downstream channels of. figure l: •• . . • 
40 ' 
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Figure 6 shows a priority schedule system for 
prioritizing processing of broadcast" ir aftd' data packets for bi- 
directional applications, according to fflfc invention.. 



. /. - Figure -7 shows '-a flowchart of a f mefhbd for prioritizing 
1 0 processing, of broadcast and data packet^ ^suitable for" use in the 
system of Figure 6; r according to the invention? ' 

Figure 8 shows a server distribution hub for 
distributing broadcast data from a plurality 'of service providers to 
15 the decoder of Figure 1 and for processing upstream data from the 
: decoder of Figure 1, -'^according to me invention; 

I:.- j ; .•;-.> : v.-Fdgure^9 lists and ; describes the exemplary interfaces 
, 1-10 .adentifiedi in the' server system of Figure 8," according to. the 
20 iinvention;. 'nr :or >.. 5 - y ' u iJ '• ' ' : " 

r.- 5 .'«. •! -Detailed' Description of the Drawings 

Figure 1 shows a decoder : system ^'providing efficient 

25 communication with a plurality of sources, according to the 
invention. The • 'decider ^system 1 advahtageously incorporates 
separate tuner, demodulator and processing paths for concurrent 
processing and decoding of data encoded in different' data formats. 
The decoder system also- -Advantageously " incorporates a separate 

30 return; channel communication pith ^rmitting 1 secure 'return 
* communication r with 1 10 V^btoWcast u source,- L for 'example.*' The 
exemplary embodiment of Figure 1 supports decoding of data in 
TCP/IP (Transmission Control Protocol/Internet Protocol) and 
MPEG. (Motion v Picture - Experts Group) ^format (e.g. per MPEG2 

35 ISO/IEC 13818-1 of 10m June 1994V and ISG/IEC 13818-2, of 20th 
January 1995). In addition, the ' set-top box ^ System of Figure 1 is 
compatible with the Multimedia Cable Networks Systems (MCNS) 
preliminary requirements. ?, : " il 

The ■ 'architecture l bf Figure 1 enables' scaleable ' (i.e. 

40 dynamically variable < biUrate) :T concurrent decoding of image. ..' 
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5 representative data from, separate sources in different formats. As 
such, data of different, .data formats may be processed by the 
scaleable decoder system of Figure 1 without being encoded in 
accordance with r an .encompassing higher layer communication 
format. Thereby,, the decoder system avoids • the overhead and 

10 inefficiency involved in processing data hierarchically' encoded 
using such an additional communication format. 

The . decoder ..system also incorporates " a scheduler 
system for prioritizing the processing .: of both received data and 
data for return , communication to a broadcast source, for example. 

15 The received, and. return data is allocated a desired hierarchical 
data output priority based on features .= including, a) a function 
associated with the data, b) a protocol characteristic of the data; or 
, c) a physical communication channel ..by u which the data is 
conveyed. Exemplary functions performed by the decoder include 

20 i) Email, ii) Internet web page browsing, Hi) Internet telephony, 
iv) conventional telephony, v). fax, vi) videophone, vii) broadcast 
video, audio and radio processing and viii) home control" functions. 
The .desired hierarchical data output priority 4s derived from a 
priority profile or map. The priority profile : comprises a database 

2 5 : ?P a i Priority u ,to data v packets;, - associated with a n 

individual function,, protocol characteristic, >or communication 
channel. The information -in the priority, profile comprises p r e - 
stored default information, user entered information, or 
information, broadcast to the decoder from, a -service provider, for 

3 0 example. The profile i may also comprise .information derived from 
several of . these sources.. ; ••;•.<•:.• . . . 

Although the decoder system is described as 
processing data received via co-axial . cable in MPEG and Internet 
protocol compatible- format, this, £ is exemplary, only. The decoder 

35 system processes data supporting > , functions : including Email, 
Internet web page browsing,, Internet telephony, conventional 
telephony,, fax, videophone, broadcast ivideo; audio and radio and 
home control functions,. Further,, the principles^ of the invention 
may be applied to systems in which the. types of transmission 

40 channels and communication protocols may vary, or to systems in 
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5 which the coding and modulation types may vary. Such systems 
may include, for example, satellite, ; : terrestnal/ ; lnterner and intra- 
net broadcast and communication 's^steriis-* u eWploying : ' non-MPEG 
, and non-Internet compatible protocols- 5 ' Further, the invention 
principles apply to the processing of any : form of data such as 

10 telephone messages.^ computer programs; Internet data or other 
communications, , for' example. 1 

In overview, in set-top >' box ;i fy&ibth 12 of Figure 1, a 
first ; carrier modulated with broadcast video 1 data and a second 
carrier modulated with Internet data, e.g. web^page information, is 

15 .received, by . splitter/combiner unit 25 - a^ !Jf processed by input 
decoder 13> Unit 13 tunes to the respective" first and second 
carriers and demodulates,- forward error' corrects and prioritizes 
the received data to provide demodulated 1 digital "data for further 
processing, by .output; decoder 20. Unit 7 13 also derives an analog 

20 video signal- from the received -data' 'fend 1 provides the signal to' unit 
20.. Unit 20-prpcesses the digital data mcluding MPEG compatible 
video and audio, data rand Internet protocol data for display and 
audio . reproduction by : units 60 and 63 respectively. In another 
mode unit ,-20. also processes the analog - video data from Wit 1 3 

25 for display by .device ,60. : '.v. ■" " ; ' *< v;i :'• r: 

, rr rA setrtopf- box: user -selects 7 'a function ib be performed, 

: e.g. the j viewing .of avparticular pro^raim -or web page data;; by on- 
screen menu selection and cursor command a using remote "control 
unit 67. Unit 15 controls the operation ^6f the elements of input 

30. decoder 13 and output decoder 20 and responds to remote control 
- unit 67 commands -using ,a bi-directional* data u and control signal 
bus C. Controller 15 controls the functions of individual elements 
within units, 13 and 20 by setting control register values within 
these elements -.. with control bus C. In 1 addition, unit 15, in 

35 conjunction with unit M3, initiates' and prioritizes the* generation 
and transmission ; of messages fdr J returh :±! communication on the 
coaxial cable Unkiito a service provider, ' for example: 

r . Considering ' Figure^ 1' in detail, splitter/combiner 2 5 
provides a*, frequency.;:-- multiplexed' signal 1 incorporating firsi an d 

40 second Quadrature Amplitude Modulated (QAM) carriers to tuners 
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5 30 and 65. The first and second carriers are independently QAM 
modulated using a selectable symbol constellation of either 256 or 
64 points. Tuner -3Q . derives a first carrier - modulated with MPEG 
compatible program, - representative audio, video and associated 
data from the t frequency multiplexed ; signal. Tuner 65 derives a 

10 second carrier modulated with Internet ■-. protocol web page 
representative data from , the frequency multiplexed signal. Tuners 
30 and 65 include, frequency^ demultiplexer, radio . frequency ('RF) 
tuner and intermediate ; frequency (IF) mixer and amplification 
stages for down-converting the signal from unit , 25 to lower 

15 frequency bands , f to derive the first . and .second carriers 
respectively. ........... ^ 

Tuner 30, in conjunction with * controller 15, 
determines whether the first carrier ^contains digital MPEG 
compatible video data or comprises* an .analog : .'video signal. A 

20 digital video data representative first carrier is provided by tuner 
30 to demodulator 40 via multiplexer (mux) 35 and an - analog 
video signal is provided via mux 35 to display processor 55 in 
output decoder 20. Tuner 65 provides ., the. - second carrier to 
demodulator 70. In this exemplary system^ ; the , input frequency 

25 multiplexed signal i from unit 25 contains 33 Physical Transmission 
Channels (PTC.s 0-32J. Each Physical Transmission Channel (PTC) is 
allocated a 6 .MHz bandwidth and contains, for- example, up to '6 
sub-channels .each with unique carrier frequency. 

It is assumed, for, exemplary purposes that a set- top 

30 box user selects, a subchannel (SC) - for viewing using . remote 
control unit 67, ^Controller 15 . uses., the , selection/ information 
provided from remote control unit 67 via . interface 69 to 
appropriately , configure elements of input decoder 13 to receive 
the PTC and corresponding carrier frequency of the. selected sub- 

35 channel SC. .Following down conversion, the first carrier- output 
signal from tuner 30 for the selected PTC has a, bandwidth of 6 
MHz and a center carrier frequency in the range of 54-806 MHz. 
In the following .discussion, an RF channel or Physical 
Transmission Channel ..(PTC) refers to an allocated broadcaster 
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5 transmission channel band which encompasses one or more sub- 
channels. > -•• ' ' • »•""•'• '■■>' : 

Controller 15 - configures the radio frequency (RF) tuner 
and intermediate frequency (IF) mixer y anid Sariiplif ication stages of 
tuner .30 to : receive the selected PTC first ; carrier frequency. The 

1 0 down-converted first carrier frequency "dtrtput for 'the' selected 
PTC provided by tuner 30, via mux 35; is demodulated by unit 40. 
The primary . functions of demodulator " 40 are recovery and 
tracking .of the carrier frequency, recovery of the transmitted data 
clock: frequency; and recovery and forward' error ' correction of it h e 

15 MPEG compatible video data itself. Unit 1 40 also recovers sampling 
and synchronization ! clocks that correspond to transmitter clocks 
and are used for timing the operation of tuner 30, demodulator 4 0 
and scheduler 43. ;>'•■' 

.< Unit: 40 demodulates the QAM modulated first; carrier 

20 signal to provide ^demodulated digital output data. Also, in unit 40, 
the demodulated t digital- output data is' mapped into byte length 
segments which are '■' deinterleaved and Reed-Solomon error 
corrected according l td known principles. In addition, unit 4 0 
provides , a o Forward Error 5 Correction (FEC)" validity or lock 

25 indication to i. controller 15. Reed-Solomon error correction is a 
known :type r dl -Forward* Error Correction. The FEC lock indication 
signals that the 1 Reed-Sol'dmon error correction is synchronized to 
the data being .- corrected and is pro viding 5 ia' valid output. It is to b e 
noted that the tutting, demodulator and" decoder functions 

30 implemented by units" 30 and 40' (and also units 65 and 70) are 
individually? known a and generally described, for example, in the 
^reference: text Digital Communication, 'Lee" and Messerschmidt 
(Kluwer -Academic - Press, Boston, MA, USA^ 1988). The recovered 
output from" unit 40 is in the : form of ah MPEG compatible 

35 transport / = rdatastream ■ containing program' representative 
multiplexed c audio, video and data components: This transport 
stream is provided to scheduler 43. 

- -The second carrier, modulated with Internet protocol 
web ,■! page representative- data, is derived by tuner 65 an'd 

40 demodulated and 1 error corrected by unit 701 "Tuner " 65 and 
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, ; r : ' 'V S ; '• 0 i i i>~- .: 8' : ... : 

5 demodulator 70 duplicate the tuner and demodulator functions of 
units 30 and ; 40. respectively and advantageously provides an 
independent , processing, path permitting concurrent processing of 
Internet protocol \.data& and MPEG compatible data, for example. 
. Tuner 65 and dempdujator .70 operate in the manner previously 
10. described in connection with corresponding units 30 and 40. 
Tuner 65 and. demodulator 70 provide data to scheduler 43 in 
Internet protocol; format representing a user selected web page. 

. Scheduler: 43 in conjunction - with controller- 15 
• prioritizes both ; the Internet protocol data from ' demodulator ' 70 
15 and the MPEG compatible, transport stream' data- -from demodulator 
40, for processing by ; elements of output decoder - 20. Scheduler 4 3 
and controller 15 also prioritize . the data for return - communication 
via the -.coaxial . cable link to a broadcast ;r source, for example. 
Scheduler 43, under control of unit, 15; identifies • individual 
20 Internet protocol packets from unit 70 'representing a specific 
function e.g. web page information requested via a' web - browser. 
. In addition, scheduler 43, under control of unit 15, identifies 
individual MPEG compatible packets representing- a specific 
. program ; e.g. "Seinfeld™" on a . selected - channel NBC™ and 
25 associated^ data. : The ; associated data '- comprises packet 
identification , and ; assembly : - information supporting the MPEG 
decoding and. : recovery of a program. i and -r also includes ancillary 
sub-picture infonnation for display -such ras 1 program guide data. 
• ••• ..: •. • ••. : / - • _h'. .''J-' ■ i.- 1 i- : c .i '<■• >. . 

30 - •.' Scheduler ,43 incorporates < a ;s demultiplexer for 
.-. matching , the PIDs of incoming MPEG packets in the datastream 
from unit 40, .with PID values . pre-loaded in control registers 
within unit, 43 by -controller 15; Similarly, : scheduler 43 matches 
data identifiers such as data source and- data destination, data 
35 type, IP address, . and Universal i Resource Locator (URL) codes in 
the Internet- .protocol datastream from unit 70 with values pre- 
loaded in control registers within unit 43 by controller 15. This 
matching process serves; to identify the function and program 
representative Internet and MPEG data packets for prioritizing 
40 and further processing. The resultant identified Internet and 
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5 MPEG packets are stored in memory and sequentially accessed in 
accordance with a predetermined • priority 4 profile ; (map) 
associating data having a specific characteristic and function with 
; a desired, priority. Thereby, unit 43 provides^ buffered prioritized 
, Internet , protocol data including -web : page> ! -HTML TM (Hyper Text 
10 Mark-up Language) -and associated Java^^data^(ahd other data e.g. 
JPEG, GIF, TIP: type «; data) . to HTML™ processor 1 75. Unit 43 also 
, . provides , > the prioritized, MPEG videos i 'audid^ and sub-picture 
packets tt? MPEG video decoder 50, ^ audio ^processor 61 and~ sub- 
picture, processor 80- respectively. The method of operation of 
1 5 scheduler. 43, and /its implementation^ is -described later : itf more 
, detail , f in ^.connection with Figures 6 and Hs - j 

^ MPEG l -decoder 50 decodes and decompresses 
prioritized MPEG compatible packetized video data from unit 4 3 
and, provides prioritized I decompressed program representative 
20 pixel r : data -for i storage: innthe pixel representative memory in 
display processor 7i > and rNTSG encoder .3*55. Audio processor- 6 1 
decodes ; prioritized ^ packetized audio ' data^ from unit * 43 and 
provides ; pripritized \ v decoded and amplified audio data 
i synchronized- r with ;•?. the associated \ decompressed video r data to 
25, device: ] 63 for : audio ^.reproduction. Processor 75 decodes - the 
ICTML™ and - Java™ encoded ! -Jweb > information from unit - 43 an d 
r -provides we>b~ page j image ^representative pixel^ data for storage- in 
memory within sub-picture:: ^processor SO. '' Processor 75 also 
decodes data encoded * in r bther formats e.g.* JPEG, TIF, 'GIF formats 
30 and in other mark-up languages e.g. SGML (Standard Generalized 
Mark-up Language) cand provides r the decoded data to sub-picture 
.processor 80 for further processing. ^ Processor 80, under direction 
of cpntroller 15, .formats: the stored^ web 'page image pixel data for 
. : storage as> .an. overlay . in . " the pixel representative memory 
35 contained , in display processor' 55 for ^ reproduction by unit 60 as a 
. merged display. o In addition** controller* 1$ incorporates a web page 
browser: supporting execution of a^ fult- complement : -of web page 
► browser ■ functions./ ^Thereby l> unit 15, together = with processor 7 5 
and 'processor! <;80, .provide a display^ via unit -60' of either acustom 
• , • i ■ " " ":\ • . 'z*:.'i-:i. : • * '■• : 

r f * „ . _ " , „ . !" . 

: . - - - \ - • i - . • - - r ■ + \ * . • ' ; • i . i • • 

£ , - ...-•«• ....... - • . • 
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5 web page browser,, o f a standard browser such as Netscape 
Navigator™ through which., full Internet access is available. 

Sub-picture .processor 80 incorporates an On-Screen 
Display (OSD) text and, .graphics generator: used in decoding and 
processing sub-picture^ data from, unit 43, Processor, 80 also uses 
10 its internal OSD, generator in creating pixel mapped data 
representing program, ..guide, subtitling, control, and information 
menu displays including selectable menu options, land other 
ancillary items. The text .and graphics produced by processor 80 
are generated .in. .the form of overlay pixel map data" under 

15 direction of controller 15, This overlay pixel, map data is combined 
and synchronized .with, the decompressed pixel data, from MPEG 
decoder 50 and decoded Internet protocol web page data from 
processor 75 in the pixel representative., memory contained in 

pixel map \ data. . representing a 

20 video program on sub-channel SC from unit. 50 together with web 
page display data and associated sub-picture^ text message data 
from unit 80 is encoded as an NTSQsignaL by processor . 55 and 
output for reproduction by, unit 60 as a ; merged display. Unit 55, 
in another mode, also encodes the, analog. video i signal provided via 

25 mux 35 from tuner ; 30 as, an ; , i: .NTSC\ signal .for output and 
reproduction by unit 60., ... .. . ; , r J( ■* , ,:, f 

-: . Set-top box system- 12, supports^ 'a. full complement of 

multimedia functions in addition to .the described exemplary web 
browsing and MPEG video processing,; functions, These multimedia 

30 functions include, . for example, - . Email, Internet . telephony, 
conventional telephony,, fax, videophone, radio, ,: broadcast audio, 
storage and... home, control K functions... The decoding and 
prioritization . principles r detailed herein are also applied in the 
processing of data for such . multimedia functions. For example, in. 

35 the processing, of Internet telephony . data, processor 7 5 
decompresses . and decodes, compressed,; audio data encoded .: in 
Internet protocol . format and assigned a ; high . level e.g: real time 
processing priority by ; unit ,43, The, decompressed . audio , .data is 
provided by processor 75 to -unit ,63. for audio reproduction. 

40 Further, processor 75 incorporates functions for the processing of 
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5 multimedia data in different i data formats and protocols for 
presentation to a user following processing' by d^its 80^55, 60/ 6 1 
and 63 in a manner similar to that previbusly^ described. 

Controller 15, in conjunction With hiodulator 85 and 
scheduler 43, . initiates and implements return channel 
10 communication with an Internet or broadcast 7 Service ' provider on 
the coaxial vcable input link via splitterfcttmbin&r 25. A message 
request; . for n : Internet web page irifbrmaticri (of a request 
associated with: another function), for exaibjjle, may be initiated 
by user selection of a displayed menu option on unit 60. Controller 
15 15, in conjunction^ with unit 85 arid ' scheduler 43 generates,. 
. prioritizes, and r encodes r the web ; pa^e request \ message for 
: , transmission <to a. service provider on the coaxial cable link via 
- unit 25v Controller 15" also determines u whether the requested 
Internet access i is- authorized from conditional* access or smart card 
20 user; ; -ejititlement?<i infontiatidn r e.g. " fr6xri a smart card unit (not 
shown to simplify ; tlie ^rawitig). If th£ requested Iiiterrtet access is 
: ; authorized &i controller- 1 IS' initiates communication With a service 
•i provider on: the rettirn channel. Con trbller 15, in conjunction with 
units, 43 sand'. 85, ;S establishes communication with the service 
2S-/.providec H ^iisSn^ipre^bred- iC Fequ£st r access data (such as telephone 
number, : - IP "address,^ URL' code '"' and cohditiHiial abcess data) and 
generates web page request message data'' The generated i 1 request 
message' data is in internet- protocdl - format and incorporates the 
, ; appropriate c source; destination 1 *and a lP : address bodes. 
30, : vi Scheduler 43 ^store's 0 and buffers the 1 web page request 

message \ data*. : packets • M ^membr^ u: aird sequentially ' accesses the 
packets in- accordance with Ji: a^pfddetehnined priority profile (map) 
associating .i. -return data 'having ^ specific characteristic and 
function . with a desired priority. ! Thereby, unit 43 provides 
3 5 buffered prioritized web page request message data to modulator 
85. Modulator 85 forward 1 '''error corrects; interleaves arid encodes 
the request message data usirig r QPSIC' (Quaternary Phase Shift 
Keying) modulation, " Unit 85 als<i optionally encrypts the request 
message i data (under direction of controller 15) in a secure data 
40 format and transmits the -encoded data with the desired * priority 
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5 to a service provider Via ; the cable link and unit 25. Unit 85 may 
alternatively '^e t .'scramble., or interleave the request message (or 
other return data) pr .employ .other protection mechanisms to 
enhance data security. :i , Such data, security is,, of particular 
importance in electronic, transaction type messages e.g. involvings 
10 credit card data. In addition, the return channel may also 'be used 
for functions such as a) telemetry including .meter .reading, b) 
video and alarm .monitoring, c) home environment monitoring, d) 
home appliance .^.moni^prittg,.- e) merchandise > ordering ..and f) 
program conditional access and entitlement management.' The 
15 method of prioritizing received, and return data; employed by 
scheduler 43 is described later in more detail .in connection: with 
Figures 6 and 7. . 

As previously described,; the- architecture of the set- 
top box system of Figure ,1 provides independent .concurrent 

20 processing of broadcast data in, different formats • and from 
different sources (e.g. MPEG program date from a broadcast source 
and Internet protocol web page, data from an Internet service 
provider). This architecture is fully .scaleable jand ; enables the 
decoding^ of .dynamically. .- partitionable ;/!:; data:.r .and bandwidth 

2 5 between .the twp, ; downstream, (e.g. MPEG and, . Internet) processing 
P a * s > , A? . SU P.!». architecture, supports 0 pqncurrent decoding of 
an MPEG j>roadcasj ..of. .ant; ^P«mp i yie : ;.and ;i a€Jfiompas>ying Internet 
web page data, ; for example... In .this example;;, the accompanying 
w .eb page data js Jntprmittent and the bandwidth occupied by the 

30 web page data may be dynamically re r allocated. ,to the MPEG data 
or other supplementary data - services. e.g program guide, Email etc. 
The architecture also permits , , the dynamic partitioning of 
bandwidth between the return., channel- path and the two 
downstream processing paths. . ^ t , .. 

35 ... Figure . 2 shows /.exemplary characteristics . of the 

downstream Internet protocol data and MPEG, broadcast .video 
channels. Although Figure. 2 shows identical , characteristics for 
both downstream channels, . .this is exemplary; w only and the 
characteristics niay be. different for each channel. Figure 3 shows 

40 exemplary characteristics of the upstream return communication 
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5 channel. Figure 4 lists the data 1 traffic type and an exemplary bit 
rate allocation for services provided 1 via 'a downstream channel of 
figure - L. Figure 5 lists the data traffic* ty^V arid" an exemplary bit 
rate allocation for services provided ; via the upstream channel of 
figure 1. The processing architecture of raV ''Set-top' box system 12 

10 of Figure- 1- is; fully scaleable • and is inc c¥^able of adaptively 
processing data --dynamically allocatetf 'between 'the two 
. dow^slceant:> : cfaaiiHers'.- :! 'Set.top : - 'box 1 'systerff 12 is also capable of 
; adaptively v processing data ^occupying ^ ; baiid width that is 
dynamically - allocable between the downstream cnaniiels and the 

1 5 return -channel;? • n v-tt>:.\t 

- o-vv:.'- v. lo . Figure 6- shows a priority kcne^ 
prioritizing processing' of MPEG broadcast "arid Internet protocol 
data packets received from units 40 and 70 (Figure 1 ) 
irespectively; ' iThe isysteni of -Figure 6 is alsbtised for prioritizing 

20 processing of data i for return cbmmunication to a service provider 
via unit 85 ; (Figure ^Iri^ihe ^system of Figure 6, input data e.g. 
MPEG, Internet protocol- TCP/IP or return data is placed in an 
input storage stack 600. Network interface 610 identifies me type 
. ;:of received tdata "iri'-stack 600 {e.g? MPEG, Internet protocol or 

25 return. & data) i^and^ formats^ ; it for identification of characteristics 
I n(attributes) ^fcy intelligent •"scheauIe^ ^ ^ 620^ i Scheduler (520 Responds 
to;/control and ^synchroniz'atibti mess¥ge^ : ' 615 Trdin i' controller ' 1 5 
(Figure 1 } ■ in- performing • intelligent' ^cHeHiu l iin^ "tu'n'c1aoni: ' J 
.v: it . - Scheduler":- 620- (Figure 6f examines me" 'formaUed '"data 

30 from interface "6lO fl f<&P function, 'p^toeol ; arid communication 
' channel - attributes ^ contained 'in : priority "profile r 640 ^stored i n 
internal; DRAM stofageP Scheduler 1 620 l aW ^ 
the^ received " data with attributes- v in the priority ' profile and 
collates the* received 1 r data : packets 5 by desirecl' output priority 

35 based on this comparison. Scheduler 620' ' f allocates storage in 
sequential' output 'FIFO (First-In Rrst-6ut) unit ^650 based on the 
desired output! priority (e:g. critical high; mediiim or low 1 priority - 
640) and provides Uhe-'ddllareti-' prioritised : dati : to allocated storage 
locations in FIFO - 650 Ada- a -high speed u DMX (Direct Memory 

. . . ,- , ....... > r 

40 Access) interface r 630.- Output processor 660 sequentially accesses 
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5 the prioritized data from FIFO "650 and formats it for further 
processing -by units : '4Q, 70"and 85 (Figure 1). 

Figure 7 shows a' flowchart detailing a method for 
prioritmng processing of input MPEG broadcast data, internet 
protocol data and return ' data suitable for use in the system of 

10 Figure 6. In step 765 l ^6f Figure 7, following the start = at step 700, 
scheduler "620 (Figure' '-' 6) receives input data and in step 710 
retrieves priority^ profit information from memory: the priority 
profile -hierarchically associates a particular desired output 
priority to input ' data 1 exhibiting a particular, attribute o r 

15 combination of attributes. The priority profile 'may be transmitted 
from a service provider, entered by a user or may comprise pre - 
stored default information' or may be derived from a combination 
of these sources. A service provider is able to provide different 
grades of service each offering a user ' different data access times 

20 at corresponding different billing rates by downloading a priority 
profile to a user's set-top box system! The downloaded priority 
profile enables the service provider to control user access to 
received information. For example, by downloading (or p re- 
installing) a priority profile, an Internet service provider may 

25 provide Internet accfess at a minimum data rate ; of 1 kbit per 
second at $10 per month and 5 kbits per second at $20 per month. 
Alternatively, a user may enter priority profile information to 
configure his system to process and communicate data or 
messages in a desired order or with a * desired, precedence. 

30 The"' Priority profile ' information may be security 

encoded e.g. by encryption, scrambling or coding for data 
protection purposes in ' order to prevent . unauthorized use of the 
high speed and premium data access levels of service* "In this case, 
the priority profile information^ is decoded (e.g. decrypted or 

35 descrambled) by controller 15 (Figure 1) in conjunction with 
scheduler 620 (Figure 6), prior to its use; *Such decryption or 
descrambling may be authorized arid" ""implemented in a conditional 
access and entitlement management system in the set top box 
system 12 of Figure 1 (not shown to preserve drawing clarity). It 

40 is to be noted that the priority profile may 'be transmitted to any 
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5 and all nodes in a network system. Sfipjbs as : -the \ .Internet or an 
intra-net, LAN or WAN etc. for assuring- quality , of service. : (QOS). 
The nodes may include network cl^yices .such as servers 
(distribution hubs), gateways, Jerniinals, routes; ,and switches. The 
priority profile may also be distributed ( .,-Sp(L used in : conjunction 

10 with communication protocols incorporating d^ta priority 
indicators for reserving network resources r to- ,ensure quality of 
Service throughout a network communiqati^a^ path ,or ; merely for 
sections of a path. Such communication protocols include, for 
example, Resource Reservation Protocol. (RSVP) Internet draft 

1 5 June 14 1 997; Real-time Transport^ Protocol r (RTP) Request for 
Comment document RFC 1889, February 1,.1996, both documents 
being available cm the Internet. . The priority profile , information 
may also be used in systems operating in accordance with 
standards defining system elements for multimedia networking 

20 and communication such as H.323 of Npvember 1996 and } H.324 
developed ~by the International Telecommunication Union (ITU). 

In step 715 of Figure 7, scheduler 620- identifies 
attributes in data received in step 705. The attributes identified 
include (i) r /protocol characteristics, (ii) function type characteristics 

25 and (iii) communication channel characteristics. 

The protocol characteristics include, for . example, (a) a 
data source identifier, (b) a data destination, , identifier, ,{c) r a ; data 
type identifier, (d) a data priority indicator, , (e) ■ a data error 
indicator, (f) an entitlement : indicator, (g) , an Internet protocol 

30 -indicator, (h) an MPBG compatible ^indicator, and (i) a packet 
' identifier-' J " . v ~ 7 - ^*'~~ \ . . ,. t . . / v . . 

The function type characteristics identify, for example, 
functions including a) Email, b) Internet web page browsing, c) 
Internet telephony, d) conventional telephpny, e). : fax, f) broadcast 

35 video processing, g) videophone processing, h) broadcast radio 
processing, i) broadcast audio ^processing .and j) home control 
functions such as alarm, telemetry,' appliance and environment 
control and monitoring. 

The communication channel characteristics identify the 

40 type of physical communication link e.g. telephone line, terrestrial; 
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5 cable or satellite link, fiber optic link, Wide Area Network (WAN), 
Local Area Network (LAN), Internet,. or intra-net. The 
communication channel .^characteristics also identify different 
channels of the same ; type of communication link e.g. different 
telephone lines. 

10 In,.>tep ( . >r 720 of Figure 7, scheduler • 620 compares 

attributes identified ' in step 715, with attributes .in- the priority 
profile and in step 725, collates the packetized input data by 
desired output priority, based on this comparison: The use of a 
priority profile in this manner provides a flexible means of 

15 structuring the priority of a wide . variety of data derived from a 
plurality of different sources. Data . may be advantageously 
prioritized by . any combination of communication, link, protocol or 
function characteristics. Thereby data of a ■ particular- - function, or 
data communicated on a particular . link, , may be prioritized by 

20 source or destination or type. Email messages, for example, may 
be prioritized according to source identifier , i.e. Email, from certain 
sources may be given higher priority. Similarly,, return messages 
to specific destinations (identified by destination identifier) may 
be allocated and coded with a higher .priority. Further, scheduler 

25 620 interprets dedicated priority indicators . e:g., an, -.Internet 
protocol data- type (precedence), indicator, in- the input, data and 
allocates this data the appropriate priority.^ Similarly, hierarchical 
processing priority may also be allocated using, the > priority profile 
based on entitlement, indicators, Internet protocol .indicator, MPEG 

30 compatible indicator .e.g. packet identifiers. •_.., « 

In step . 730, scheduler, 620 . allocates storage in a 
sequential output FIFO (First-In First r< Out unit 650 of Figure 6) 
based on the desired, output priority and, provides the collated 
prioritized data to the allocated storage locations in FIFO. 650 via a 

35 high speed DMA (Direct, Memory, Access) -interface 630., The 
collated prioritized packet data is ..output from FIFO 650 with the 
desired output priority in step 733 (Figure 7). In . step 735, the 
collated prioritized output data is processed . for reproduction and 
presentation to a user or for return transmission to a service 

40 provider. Such processing may involve encoding and encrypting 
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5 the data for secure return; communication, for example, and 
synchronizing the data with dither "sfet-to'p^ box processes^ The 
process ends at step 740. rr.'r/n; 

Figure 8 shows a server diminution hub 102 for 
distributing -broadcast data and providing multimedia services 

10 from one or more service providers 109 to the set-top- box system 
.12 (Figure 1 and- 8) and 5 for processing "upstream data from unit 
12/ according to the invention. QAM Modulated broadcast data 
such as; MPEG compatible video data or analog representative 
video data from one or more service providers 109? (Figure 8) is 

15 provided via optical fiber link 145 J and channel 135 to mux 125. 
Unit 125r provides a multiplexed output from sources including the 
received broadcast data from channel 135, local hub generated 
data 137, and » r frbni QAM modulated 'data from cable modem 
•* termination 150 (via "up converter "134). The multiplexed output 

20 from mux 125 is output to optical fiber communication interface 
120. Unit 120 communicates with set-top box system 12 of Figure 
1 by transmitting dawristream QAM data and receiving upstream 
QPSK (or QAM) data On high frequency channel 110 via optical 
fiber link -115,' cdax 105 and electrical to optical converter . 107. 

25 - -'Upstream data from set box 12 lis received by ^unit 120 

via channel ; M0 "arid routed via splitter 15'5 : and dowh converter 
' : 160* ! to - cable n modem-' termination system v 150. System' 1 5 0 
demodulates the QPSK modulated upstream data from converter 
160 and' provides" the demodulated upstream data to. service 

30 provider 109 via network" interface 1 154, optional hub switch 140 
and optical fiber link- 145 ^Alternatively/ optional hub switch 140 
may provide the ' demodulated upstream data to an optional WAN 
device 130- Unit 1 154 of system 150 also receives downstream 
data from service* provider 1 09 or WAN' device 130' via switch 

35 140. Unit •154 :/ formats arid processes the downstream data from 
' switch 140 -and provides it tauriit 152 for QAM; modulation and 
subsequent 4 up conversion'' by converter 134. The up-converted 
data from cbnyerter 134' is transmitted to set-top box system 12 
via -mux' 125 : as ' previously described. : .- 
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Figure 9 lists and describes the exemplary interfaces 
1-10 identified in the server S ystem : of Figure 8, according to the 
invention. . 

• ' The ^clihecipres, of Figures 1, 6 and 8 are not 

exclusive. Other architectures may be derived in accordance with 
the principles of the. invention to accomplish the same objectives. 
Further, the functions of the elements: of system 12 of Figure 1 
and the process r ^eps of jFjgure 7 may be implemented: in : whole or 
in part within the programmed instructions of a microprocessor. 



WO 99/18718 PCT/US98/20705 

1 9 

5 CLAIMS 

1. Video decoder apparatus (ld;20r input 
video data encoded according to a plurality of different data 
formats and received on a common phyiical J communication link, 

10 comprising: - ■ - ^jiia^n i: ■'. . 

: :a first --processor (50)" for / decoding image 
representative data packetized in an Interriet ' protocol compatible 
data format and received on said common 6dmmunication link, to 
provide a first decoded video output; u ;3 x 

15 a second processor (75) for concurrently decoding 

broadcast video data packetized in an MPEG compatible data 
format exclusive of said Internet protocol data format and 
received on said common communication link, to provide a second 
decoded video output, wherein the proportion of said image 

20 representative data conveyed on said common communication link 
relative to said broadcast video data may be dynamically varied; 
and 

a display processor (55,80) for forming a display 
image from said first and second decoded video outputs. 

25 

2. Apparatus according to claim 1, including 

a first demodulator (40) for demodulating data 
modulated in a first modulation format to provide said image 
representative data; and 
30 a second demodulator (70) for demodulating data 

modulated in a second modulation format to provide said image 
representative data. 



35 



3. Apparatus according to claim 2, wherein 

said first and second modulation formats are the same. 
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5 . .. 4 - Apparatus according to claim 1, including 

an encoder. .(43,15) for encoding data for return 
communication to a broadcast , source; and 

a modulator (85) for modulating encoded data in a 
return modulation format for return communication to a broadcast 
1 0 source via said common, communication link. 

. 5.. Apparatus according to claim 4, wherein: 
said encoder is. capable of sending messages via said 
return channel supporting , one or more functions selected from a) 
15 telemetry including utility meter reading, b) video : monitoring, c) 
an alarm function, d) home, environment monitoring, . „e) home 
appliance monitoring f) merchandise ordering an.i g) program 
conditional access and entitlement management. , -. 

20 6. Apparatus according jo claim : 4, wherein 

said return modulation format is different to a 
receiving modulation format. . 

7. Apparatus according, to claim 1, wherein , . . . 

2 .5 • , . first processor .is .capable , of processing messages 

via said, common .communication, channel supporting . one qrrmore 
remote functions selected from a) video recorder programming, b) 
electronic transactions,, c) videophone, ,d) :j Internet telephony, e) 
local community -,. programming, f) .. merchandise ordering, g) 

30 targeted advertising,, h) stock . trading, and i) home control. 

8. Apparatus according to claim .1, including 

a means for identifying data (15,35) received on said 
common communication link as. analog broadcast format data and 
35 for processing said analog broadcast format data to provide data 
for display. 
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5 9. Apparatus according to claim 1, including 

means for identifying' syfrcfiVd^^ (15) 
in input data received on said common 'communication link for 
synchronizing said first decoded Vided" output with said second 
decoded video output: i0 ' L 

10. Video decoder apparatus ifbr "decoding input video 
data encoded according to a plurality of data formats and received 
on a common physical communication Ii r ftk, comprising: 
• : a ' first processor (50)* foV "decoding image 

15 representative data 'packeti zed according °tb 'an Iriternet protocol 
data format ahd received on said comriion cbmmunication link, to 
provide Ja first decoded video output; ' ;i " " " fj 

» • second -processor (75) for dedoditig broadcast video 

data packetized according to an MPEG compatible data format 
20 exclusive of said Internet protocol data format and received on 
said common eommumcation iink, to provide a second decoded 
video output; 5 ^ - - 

a third processor (15,43,85) fbf modulating encoded 
data in a return modulation format for return communication to a 
25 broadcast : S6tirce via" said tomnibii commu^idatibn link; and 

■! ! : ^ display processor (55,Sd) ; fcf fbmiing a display 
image from said iftist atid^secoiid ' dec o deti ; 1 Video" outputs*. 1 ? ' 

: ^ 1 13 apparatus'"'' £c£brding to claim 10^ 7 wherein ' : " 

30 skid "third processor : collated infoirriiktidn supporting 

one or more fUhcfioris ' selected from a) telemetry mcludihg me t e r 
reading, b) video monitoring, c) an alarm function, d) home 
environment ' moiiitbfing, ' e)' 'home appliance monitoring, f ) 
merchandise ordering; g) electronic 1 transactions, h) program 
35 conditional ' ^ccfess 'arid entitlement management. 
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format. 
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12. Apparatus according to claim 10, wherein 
said third ^ processor* encodes data in a secure data 



10 



!3. Apparatus according to claim 1.2, wherein 

said secure data format is one or more of ai) an 

encrypted format, b) a coded format, c) a scrambled format and d) 

an interleaved format. 



14. Apparatus according to claim 10, wherein 

15 said return communication is secure by means of being 

point-to-point communication. 

15. Apparatus according to claim. 10, wherein, ... ... 

said Internet protocol data _ format includes data 

20 encoded in at least one of a) HTML™ format, b) Java™ format, and 
c) ActiveX™ format. 

16. Apparatus according to claim 10, wherein 

said first processor is capable of processing messages 
25 via said common communication channel supporting one or more 
remote functions selected from a) video recorder programming, b) 
electronic ^ trahsactioris, c) videophone, d) Internet, telephony, e) 
local community prbgrammingV f) merchandise ordering, g) 
targeted advertising, h) stock trading and i> home control 
30 ' '• • ■'••'« : V-"' • — • - " ~ :i '■ ■ 
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5 17. Video decoder* apparatus for .decoding input video 

data encoded according to a plurali^W^data^lbmats and received 
on a common physical communication link, comprising: 

a first processor (50) for decoding image 
representative data packetized according, to an Internet protocol 
10 data format 1 and received on said common communication link, to 
provide a first decoded video output; 

: ii a~ secbrid processor (75) for decoding broadcast video 
data packetized according to an MPEG compatible data format 
exclusive of said Internet protocol data format and received on 
1 5 said coiiimon communication link, " to a r second decoded 

video output; 

a third processor (15,43,85) for encoding data for 
return communication to a broadcast source via said common 
communication link; ' 
20 - ^ ^ * meafttf 1 A,J tor ;^ sy^hrQnizihg ^ " (15,55,80) said return 

communication with' 1 receiving data on said, common 
communication link; 
and 

' a 1 display (55,80) for' forming a display 

25 image from' said' first and second decoded video outputs. 

"18. Apparatus according to claim 17 ^ including, 
mfeans for identifying synchronization indicators (15) 
in input data received on said* common communication link for 
30 synchronizing said 'first' decoded video output with said second, 
decoded video output. 
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5 19. -A method for decoding input video data encoded 

according to a plurality of data formats and received on a common 
physical communication link, comprising the steps of: 

decoding image representative data packetized 
according to an- Internet protocol data format and received on said 
10 common communication link, to provide a first decoded video 
output; , (•- . . : . 

decoding broadcast video data : packetized according to 
an MPEG compatible data format exclusive of said Internet 
protocol data format and received on said common communication 
15 link, to provide' a second decoded video output, wherein the 
proportion of said: •image representative^ data conveyed on said 
common communication link relative td .said broadcast video data 
. may be dynamically varied; and 

./ forming a display image from said first and second 

20 decoded video outputs. 
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INTERFACE # 


PHYSICAL FORMAT 


DESCRIPTION 


1 


CABLE MODEM TERMINATION 
SYSTEM-NETWORK SIDE 
INTERFACE AND CABLE MODEM 
T ERMINATlON SYSTEM SECURITY 
MANAGEMENT INTERFACE 

FOR EXAMPLE 

SONET ATM OVER OC-3. FAST 
ETHERNET OR ANOTHER 
INTERFACE 


THIS IP BASED PHYSICAL INTERFACE 
SERVES SEVERAL LOGICAL FUNCTIONS: 

• ACCESS TO THE SECURITY AND ACCESS 
CONTROLLER SERVER. CABLE MODEM 
TERMINATION SYSTEM SECURITY MANAGEMENT 
INTERFACE THIS COMMUNICATION LINK IS 
IMPLEMENTED USING A SECURE NETWORK ACCESS 
PROTOCOL SUCH AS REMOTE AUTHENTICATION 
OWLWSER SERVICE(RADIUS). THE SECURITY 
SERVER IS IMPLEMENTED ON AN OPEN COMPUTING 
PLATFORM. AND CAN RP^inP IM TUP PCUTDAi ucAn 

END AS A PART OF A PROXY SERVER CLUSTER 

• DATA TRAFFIC. THIS INaUDES ALL SERVICES 

ffiPE^£L DATA - VIDEO-ASSOCIATED DATA 
jrfRACTIVE PROGRAM GUIDES, AND OTHERS) TO 
THE STU AS A PART OF THE INTERACTIVE CHANNEL 

• RETURN TRAFFIC GENERATED BYTHE STU. 
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SAME AS t ABOVE, PROVIDED BY 
A LOCAL ATM SWITCH IN CASE 
MULTIPLE DEVICE ACCESS TO 
WANATTHE LOCAL HUB IS 
DESIRES. 


AS ABOVE 
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THE REVERSE DATA CHANNEL IS 
QPSKOR 160AM MODULATED 
OVER AN ELECTRICAL LINK. 


2-10 MbpsRETURN DATA RATE DEPENDING ON THE 
CHARACTERISTICS OF THE CABLE SYSTEM AND THE 
MODULATION TECHNIQUE 
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THE FORWARD DATA CHANNEL IS 
64-QAM-MOOULATEDOR256QAM 

1 l/VM H ITCfl IMICB All 

MODULATED OVER AN 
ELECTRICAL LINK. 


27 Mbp FORWARD DATA RATE FOR 640AM 
MODULATED SYSTEM. 
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CABLE MOOEMTERMNATION 
SYSTEM UPSTREAM RF SEE 
INTERFACE (QPSK/16 QAM 
MODULATED). 


MCNS VARIABLE LENGTH DATA PACKET FORMAT. 
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CAa±M0OEMTERMWATlON 
SYSTEM DOWNSTREAM RF SEE 
NTERFACE (QAM MODULATED). 


IP OVER MPEG DATA PACKET FORMAT. CONVERSION 
FROM IP OVER ATM WCOMWG INTO THE CABLE 
ROUTER IS PERFORMED AUTOMATICALLY BY THP 
DEVICE 


7 | 


RF FREQUENCY COMBNER (54- 
750MHz) OVER AN ELECTRICAL LWC 
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RF FREQUENCY SPUTTER (5- 
42MHz) OVER AN ELECTRICAL UNK, 
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AlLAJfW II A TCn HI/CD A01Y*AI 

FIBER (OPTICAL LINK). 


ELECTRICAL TO OPTICAL AND CrnCAL TO ELECTRICAL 
CONVERSION AT THE HUB IS PERFORMED BY THE 
TRANSMTTTER AND RECEIVER RESPECTIVELY. 


10 


DIGITAL SET-TOP UNIT INTERFACE 
OVER THE COAXIAL CABLE FROM 
THE NODE 107. 


OPTICAL TO ELECTRICAL CONVERSION IS PERFORMED 
AT THE NODE 107. 
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